[pull] master from apache:master - #639

Prepares the structured streaming runner for a Spark 4 streaming
translator without changing batch behavior.

- Add PipelineTranslatorFactory, the seam the Spark 4 module shadows to
  dispatch streaming pipelines. The shared base rejects streaming with a
  clear message instead of the previous generic checkArgument.
- Open up EvaluationContext (non final, protected ctor, leaves()) and add
  a no-op stop() so a streaming context can override evaluation.
- Add a createEvaluationContext hook to PipelineTranslator and skip the
  persist and lineage breaking optimizations for streaming datasets.
- Plumb the EvaluationContext into SparkStructuredStreamingPipelineResult
  so cancel() can stop a running streaming query.
- Default the state store provider to RocksDB, required by Spark 4
  transformWithState and inert for batch.
- Add watermarkDelayMillis, maxRecordsPerMicroBatch, maxBatchDurationMillis
  and streamingStopAfterIdleBatches options.
- Narrow the Spark 4 test source override exclude to the legacy DStream
  package. The previous glob also matched structuredstreaming and would
  have silently dropped the structured streaming tests.